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(57) Abstract 

Systems and methods for selecting and inserting advertise- 
ments in an infoxmation document displayed to a user, wherein 
the selection is based at least in part on television programming 
viewed by the user. The systems and methods may be imple- 
mented using the Internet or another information retrieval system 
that includes a client system (10) and a remote server (16). The 
client system (10) nronitors television programming (52) viewed 
by the user and compiles a user profile (54) characterizing the tele- 
vision programming. When the user requests an Internet resource 
using the client system (10), die television programming informa- 
tiOT in the user profile (54) is utilized (64) to select an appropriate 
advertisement m). Jht advertisement (78) is then inserted (76) 
in the information document (22) and displayed (20) to tfie user. 
Such selection of advertisement increases tfie efficiency by which 
Internet advertisements are tailored to individuals. Instead of ad- 
vertisements, information relating to the television programming 
may be retrieved over die Internet and displayed wiUiout direct 
user assistance. 
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SYSTEM AND METHOD OF INSERTING ADVERTISEMENTS INTO AN 
INFORMATION RETRIEVAL SYSTEM DISPLAY 
BACKGR OUND OF THE INVENTION 

1. The Fidd of the Invention 

The present invention relates to advertising on an infonnation retrieval system. 
In particular, the present invention relates to systems and metiiods of selecting 
advertisements and displaying the selected advertisements on an infonnation retrieval 
system based at least in part on the television viewing habits of the recipient of the 
advertisCTients. 

2. The Prior State of the Art 

The Internet, and particulariy the Worid Wide Web ("Web"), has experienced 
tremendous growth during recent years. The Web aUows users to retrieve and access 
text, graphics, audio, video, and otiier infonnation from remote servers. The Web has 
become a valuable source of news, educational resources, commercial infonnation, 
entertainment, and the like. Many, if not most, Web sites are accessible by users free 
of diarge. Othw »tes are made available to users for a small fee. Many Web sites 
subsidize part or aU of the cost of maintaining a server, posting infonnation in Web 
pages, etc. by selling and distiibuting advertisements embedded in Wrf) pages. 

As in other advertising appUcations, it has been found that advertisements in 
Web pages are most eflFective if tiiey can be tailored and directed to segments of the 
population that are likely to be interested in the advertised goods and services. 
Because of the interactive nature of the Internet and the ability to easily insert 
graphical images in Web pages, tiiere have been developed several metiiods of 
targeting Interasi advatisements to spedfic users or spedfic groups of users. 

One of the simplest ra^ods of tailoring Internet advertisements to recipients 
is similar to techniques used in television, radio and oUier media; In particular, 
advertisements are selected to conespond to the subject matter of the Web page or 
other Internet resource. It is assumed that users who actively retrieve Internet 
resources dealing witii a certain topic are more likely than the population at large to 
be receptive to advertisements directed to the topic. For example, if a Web site relates 
to travel infonnation, advertisers and Web site providers can generally assume that 
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«s«s .oce^tag Web site will tave . hdgluened i„ ,„ve,.,el««l 

advertisements. 

Advertisements are particularly attractive in the Internet environment for 
several additional reasons. Fir^ Internet u^s are typicaUy actively and attentively 
takmg m mformation when they access Internet resources. Such users may be more 
receptive to messages deUvered by advertisers than per«,ns engaged in other 
activities. Second, because of the interactive nature of the Internet, recipients of 
advertismg may choose to receive a smaU amoum or a relatively large amount of 
.nformaUon on the advertised goods or services. For example, a typical Internet 
adv^tisemem may consist of a bam^er box or another graphical image identifying ti^e 
goods or services or presenting a condse advertising message. Moreover Ute 

graphical image is frequentiy an active link that may be selected by the user in order 
to access a Web site specifically dedicated to tiie advertised goods or services 
Accordingly, imerested recipients may easily retrieve additional infonnation relating 
to advertiser's message, while disinterested recipients are not inconvenienced by too 
much unwanted information. The multimedia aspect of tiie Internet also allows 
advertisers to present their messages in new and interesting ways. 

In addition to basing advertisement selection on tiie subject matter of Web 
sites, advertisers have also been able to learn of some preferences and habits of 
recipients in order to more eflFectively taUor advertisements. Many Web sites 
download "cookies" to users' computers when users access tiie Web sites. Cookies 
are files installed and stored on the hard disk of cUent computers and are used to 
report mformation relating to the cliem computer to Web site content providers In 
one example, a cookie may merely be an identifier tiiat transmits a user password or 
other Identifying information each time the user returns to the Web site, thereby 
ehmmatmg the need for the user to remember and enter the password. In another 
example, however, cookies can be used to track and report tiie user's Internet habits 
gtvmg content providers and advertisers insight into the possible interests of the user' 
and allowmg advertisements to be tailored accordingly. 

Services tiiat automatically provide news and otiier infonnation to recipients 
over tiie Internet have also become common. For example, tiiere are many e-mail 
services and oUier Internet-based systems that periodically send messages or other 
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infonnation documents relating to specific topics to interested persons. GeneraUy, 
such services provide infonnation to recipients who have placed their names in a 
subscriber list. There is typically no attempt to individually tailor the information sent 
to the subscribers based on the subscribers' particular preferences other than perhaps 
an interest survey submitted by the subscribers. 

In view of the foregoing, advertising techniques adapted from other media 
have been widely used to tailor advertisements to broad segments of the Internet- 
using population. Furthermore, interactive techniques, such as tiiose involving 
"cookies", allow advertisers to learn of some of tiie recipient's habits as they relate to 
browsing Internet and otherwise usuig the recipient's computer. While such 
infonnation increases the efficiency by which advertisers may target specific 
recipients, any further source of infonnation relating to individual habits and 
preferences would be a valuable improvement in the Internet advertising industry. 

From the standpoint of tiie advertiser, any increase in tiie ability to nanowly 
target recipients would make advertising on the Internet more attractive. Internet 
content providers would also favor advancements in advertising eflfectiveness, since 
tiiey would then coUect more advertising fees fi-om advertisers. FinaUy, tiie Internet- 
using pubHc benefits from being more effectively targeted in at least two ways. First, 
advertising recipients would be more likely to receive advertising infonnation tiiat is 
of interest and value. Second, a greater number and variety of Internet sites are likely 
to be profitable using improved advertising techniques, tiiereby making more no-cost 
and low-cost Internet sites available to the public. 

SUMMARY OF TFTF INVENTION 

The present invention relates to selecting advertisements and displaying tiie 
seleaed advertisements on a display screen of an infonnation retrieval system based 
at least in part on tiie television viewing habits of the recipient of the advertisements. 
For example, the infonnation retrieval system may be tiie Internet, witii the 
advertisements being embedded and displayed in a Web page or another Internet 
resource. Monitoring tiie television viewing habits of the recipient allows the 
advertisements to be more effectively tailored to tiie specific habits and preferences of 
the recipient. 
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The invention may be implemented in an infonnation retrieval system 
.ncludmg a dient temunal and a remote server configured to communicate one ^vith 
another. In Internet implementations, an Internet service provider ("ISP") may also 
be present in order to feciHtate and route infom^ation transmission over the system 
Moreover, the client terminal is comiected to. associated with, or otiierwise has access 
to a television set or a television programming feed. According to the invention, the 
cUent temunal monitors television programming viewed by the user, and includes ti,e 
television viewing habits in a user profile. 

When tiie user requests an information document, such as a Web page from a 
remote server, the user profile is used in conjunction witi, selection criteria to select 
an advertisement appropriate for tiie user. Data representing tiie selected 
advertisement is inserted into Uie infommion document, and when tiie information 
document is displayed to tiie user, tiie selected advertisement is also displayed The 
process of selecting and inserting the advertisement may be conducted according to 
any of at least three metiiods. In particular, tiie advertisement selection and insertion 
rnay be conducted at tiie dient computer, at tiie server computer, and in Internet 
unplementations. at ti« ISP. Moreover, selection and insertion may be conducted at 
any combination of tiie foregoing sites. 

The foregoing metiiods of advertisement sdection and insertion more 
generally extend to sdection and display of any type of information to a recipient 
based at least in part on television viewing habits. As described herein, the client 
tenmnal momtors tdevision programming viewed by the user and compUes a user 
profile. The user profile is compared against a list of infomiation categories, which 
may be standard or user-defined. One or more of tiie information categories tiiat 
correspond to the user profile are tiien used to request information documents from 
the server computer. For example, the invention may be implemented in an Internet 
news deliver, service wherein tiie infonnation categories correspond to particular 
categories of news stories. Accordingly, information sudi as news, entertainment 
educational resources, and tiie like, may be selected based at least in part on the 
television viewing habits of tiie redpient, automatically retrieved, and made available 
to the recipient. 
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In view of the foregoing, the invention disclosed herem provides methods and 
systems for taUoring advertisements and other information to specific recipients in 
ways tiiat have not previously been possible. Monitoring the television viewing 
habits of recipients allows advertisers and content providers to gain valuable insight to 
the preferences of tiie users. Accordingly, tiie advertisements or other selected 
information is more likely to be relevant and of interest to the recipient using the 
invaition than using conventional methods. 

Additional advantages of tiie invention wUl be set forth in tiie description 
which foUows, and in part wiU be obvious torn the description, or may be learned by 
tiie practice of tiie invention. The advantages of tiie invention may be realized and 
obtained by means of tiie instruments and combinations particulariy pointed out in tiie 
appended claims. These and otiier features of tiie present invention will become more 
fiilly apparent from the foUowing description and appended clauns, or may be learned 
by the practice of tiie invention as set forth herdnaftw. 

BRIEF DES CRIPTION OF THE DRAWINGS 

In order tiiat tiie manner in which the above-redted and otiier advantages of 
tiie mvention are obtained, a more particuhir description of tiie invention briefly 
described above wiU be rendered by reference to specific embodiments tiiereof which 
are iUusti^ed in tiie appended drawings. Understanding tiiat tiiese drawings depict 
only typical embodiments of tiie invention and are not tiierefore to be considered 
Umiting of its scope, tiie invention will be described and explained with additional 
specificity and detaU through tiie use of tiie accompanying drawtogs in which: 

Figure 1 is a schematic diagram iUustrating a networic system in which the 
invention may be implemented, wherein tiie networic system includes cUent terminals, 
servers, and a tdevision programming source. 

Figure 2 is a schematic diagram of one embodunent of a client system for use 
with the invention. 

Figure 3 A is a schematic diagram depicting a first embodiment of the systems 
and methods of tiie invention, wherein an advertisement is selected and inserted into 
an information document at the server computer. 
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Figure 3B is schematic diagram showing a second embodiment of the systems 
and methods of the invention, wherein an advertisement is selected and inserted into 
an information document at the level of the Internet service provider. 

Figure 3C is a schematic diagram iUustiating a third embodiment of the 
systems and methods of the mvention, wherein an advertisement is selected and 
inserted into an information document at the cliem system. 

Figure 4 is a flow diagram depicting selected steps of the methods associated 
with Figures 3A-3C. 

Figure 5 is a schematic diagram showing a further embodimem of the systems 
and methods of the invention, wherein information classified under specified 
categories is selected, retrieved, and displayed based at least in part on tixe television 
viewing habits of the recipient. 

Figure 6 is a schematic diagram furtiier illustrating a television monitoring 
module and associated elements of die systems of tiie invention. 

DETAILED DESTRTPTTON OF THF ppfpiti ^d R]VfBOnnvrir^rr« 

The present invention relates to selecting and displaying advertisements or 
other information on a display device of an information retrieval system based at least 
in part on tiie television viewing habits of tiie recipient. A cUent terminal or the like 
monitors the television viewing habits of the recipient, which are included in a user 
profile. The user profile, in combination witii selection criteria, may be used to select 
advertisements for display to the recipient. When tiie recipient requests an 
information document using the information retrieval system or when an information 
document is otiierwise delivered to the client terminal, ti,e selected advertisement is 
inserted into the information document and is displayed to the recipient. 

The invention is described below by using diagrams to illustrate either the 
structure or processing of embodiments used to implement the system and metiiod of 
tiie present invention. Using the diagrams in this mamier to presem the invention 
should not be construed as limiting of its scope. The embodiments of tiie present 
invention may comprise a special purpose or general puTK,se computer including 
various computer hardware, as discussed in greater detail bdow. The embodiments 
may further comprise multiple computers Unked in a network enviroranent. 
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Embodiments within the scope of the present invention include computer 
readable media having computer-executable instructions or data fields stored thereon. 
Such computer readable media can be any available media which can be accessed by 
a general purpose or special purpose computer. By way of example, and not 
limitation, such computer readable media can comprise RAM, ROM, EEPROM, CD- 
ROM or other optical disk storage, magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to store the desired computer- 
executable instructions or data fields and which can accessed by a general purpose or 
special purpose computer. Combinations of tiie above should also be included within 
the scope of computer readable media. Computer-executable instructions comprise, 
for example, instructions and data which cause a general purpose computer, special 
purpose computer, or special purpose processing device to perform a certain fiinction 
or group of fiinctions. The computer-executable insti^ictions and associated data 
fields represent an example of program code means for executing the steps of the 
invention disclosed herdn. 

Figures 1 and 2 and the foUowing discussion are intended to provide a brief, 
general description of a suitable network and computing environment in which the 
invention may be implemented. Altiiough not required, the invention will be 
described in the general context of computer-executable instructions, such as program 
modules, being executed by a personal computer. Generally, program modules 
include routines, programs, objects, components, data structures, etc. tiwt perform 
particular tasks or implement particular abstract data types. The invention will also be 
described by making reference to information documents, which generally include or 
are defined by encoded data structures stored in a computer-readable medium or a 
computer memoiy device. The encoded data structures of documents typically 
represent text, graphical images, audio, or other information that may be 
communicated to a user, and generally may be generated, edited, displayed and/or 
stored using a computer. The information documems may be Web pages or other 
Internet resources. 

For illustration purposes, the invention is described herein in reference to tiie 
Internet, which represents one example of information retrieval systems that are 
compatible with tiie invention. However, tiie principles disclosed herein are also 
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appLcable to other irformation retrieval systems. Accordingly, it is to be understood 
that the invention is not to be limited to the Internet. Those skiUed in the art wUl 
understand how to implement the invention in other information retrieval systems 
upon learning of the information disclosed herein. 

Figure 1 iUustrates one embodiment of the architecture of an information 
retneval system in which the invention may be implemented. In this embodiment, 
multiple clients systems 10 communicate with a modem pool 12 by means of direct- 
dial, bi-directional data connections 14, which may be conventional telephone lines 
ISDN comiections. connections supported by cable television providers, or any oUier 
suitable communications channel. Modem pool 12 may be any conventional modem 
pool, such as those tiiat are currentiy u^ for providing access to the Internet and 
other wide area networks. For example, modem pool 14 may be provided by a local 
ISP. Thus, modem pool 14 may be coupled to a number of server computers, such as 
remote servers 16, via a conventional network infiastruchire. which may be Internet 
infrastructure 18. 

Figure 1 fiutfier illustrates an example of combining infoimation retrieval over 
ihc Internet with television viewing. At least some of cUent systems 10 ai^ associated 
wiUi display devices 20 tiiat serve a dual function. Fir^ display devices 20 display 
graphical, computer-generated or computer-transmitted information provided by 
client systems 10. Web pages retrieved from remote sender. 16 represent one 
example of tiie graphical information tiiat may be displayed on display devices 20 
Second, television programming transmitted from television programming source 22 
may also be displayed on display devices 20. Television programming source 22 may 
be any desired television broadcaster or deUver, system. Accordingly, display device 
20 may be a conventional television or may instead be a computer momtor adapted to 
display television programming. Indeed, tiie client system is optionally integrated in a 
television, or instead inay be a self-contained unit. The invention extends to systems 
•ncoiporating the information retrieval systems disclosed herein in combination with a 
home entertainment system including a television or anotiier display device 20 It is 
also noted that client teiminal 24 is defined herein to include the client system and the 
display device. 
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Figure 2 depicts selected demits of one embodimait of a dient system that 
may be used to implements portions of the invention. Client system 10 uses hardware 
and computer-executable instructions for providing the user with a gnq>hical user 
int^ace, by which the user can access Internet resources, send and recdve e-mail, 
and optionally receive other information services. Operation of dient system 10 is 
controlled by a central processing unit (CPU) 26, \s4uch is coupled to an application- 
spedfic integrated drcuit (ASIC) 28. CPU 26 executes computer-executable 
instiuctions designed to implement features of dient system 10, induding some of the 
steps of methods of the present invention. ASIC 28 contains circuitry which is used 
to implement certain functions of client syst^n 10. For example, ASIC 28 may be 
coupled to an audio digitai-to-analog converter 30 and to a video «icoder 32, which 
provide audio and video output, respectively, to display device 20 of Figure I. 

Client system 10 may further indude an IR interfece 34 for detecting infrared 
^gnals transmitted by a remote control input device, such as a hatKl*held device or a 
wireless keyboard. In response to the infrared signals, IR interface 34 provides 
corresponding electrical signals to ASIC 28. Altemativdy, the signals transmitted by 
r^ote control device 14 may be selected from another suitable re^on of the 
spectrum. A standard tdephone modem 36 and an ISDN modem 38 are coupled to 
ASIC 28 to provide connections to modem pool 12 and, via the Internet 18, to remote 
serv«^s 16. While the client system illustrated in Figure 2 includes both a tdephone 
modem and an ISDN modem, either one of these devices is sufficient to support the 
communications of the client system. Furthermore, in other ^bodiments, modems 
36 and 38 may be supplemented or replaced with cable modem 40 or another suitable 
communications device. In other envirorunrats, conununication may instead be 
^tablished using a token ring or Ethernet cormection. 

Also coupled to ASIC 28 are a mask read-only memoiy (ROM) 42, a flash 
memory 44, and a random access memory (RAM) 46, Mask ROM 42 is non- 
programmable and provides storage of computer-executable instructions and data 
structures. Flash memory 44 may be a conventional flash mraiory device that can be 
programmed and erased electronically. Flash memory 44 may store Internet browser 
software as well as data structures. In one embodiment, a mass storage device 48 
coupled to ASIC 28 is included in client system 10. Mass storage device 48 may be 



wo 00/54504 



10 



PCTAJSOO/05326 



used to supply computer-executable instructions and data structures to other 
components of the cUent system or to receive data downloaded over the network. 
Mass storage device 48 may include any suitable medium for storing computer- 
executable instructions, such as magnetic disks, optical disks, and the like. 

AppUcation software and associated operating system software are stored in 
flash memoiy 44, or instead may be stored in any other suitable memory device, such 
as mask ROM 42 or mass storage device 48. The computer-executable instructions 
that, according to one embodiment of the invention, are used to monitor television 
viewiiig habits of a user and to construct a user profile that forms at least part of the 
basis for selecting advertisements are executed by CPU 26. In particular. CPU 26 
executes sequences of instructions contained in one or more of mask ROM 42. flash 
memory 44, and RAM 46 to perform certain steps of tiie present invention ti«t ^ be 
more ^jedfically disclosed herdnafter. 

In one embodiment of the invention, client system 10 is a WebTV client box 
maraifactured by WebTV Networks, Inc. of Palo Alto, Califonua. One reason that 
WebTV cUent boxes may be conveniently used witii tiie invention is tiiat tiiey include 
television interfece features that combine Internet browsing witii television viewing. 
For example, tiie disphiy device that is typicaUy used to graphically display Web 
resources retrieved by a WebTV system is a conventional television. Furthermore, 
WebTV client boxes may be adapted to monitor television viewing habits as further 
disclosed herein. Alternatively, client system 10 may be any of a variety of systems 
for providing access to tiie Internet or otiier infomation retrieval systems. When a 
WebTV client box is used as cUent system 10, the networic architecture iUustrated in 
Figure 1 may forther include a dedicated server 50, which is dedicated to providing 
information specifically to WebTV cUents boxes. 

The elements of client system 10 are not limited to those depicted in Figure 2. 
For example, tiie invention may be used with otiier computer system configurations, 
including personal computers, hand held devices, multiprocessor systems! 
microprocessor-based or programmable consumer electronics, networic PCs, 
minicomputers, mainframe computers, and tfie like. The invention may also be 
practiced b distributed computing enviromnents other tiian the network enviromnent 
of Figure 1. For example, the invention may be used in any suitable network 
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environment viiere tasks are performed by remote processing devices that are linked 
throu^ a comniunications network. 

Figures 3A-3C illustrate three embodiments of the invwition, wherein 
advertisements are selected and inserted into an information document based at least 
in part on tdevision viewing habits of the redpient. In general, the embodiments of 
Figures 3A-3C are configured to monitor the television viewing habit of a user of the 
client system and to construct a user profile that includes the television viewing 
habits. Based at least in part on the television viewing habits, an impropriate 
advertisement is sdected according to advertisement selection criteria. The selected 
advisement is inserted into an Internet document and is displayed to the user on the 
display device. Advertisement sdection and insertion is conducted at the remote 
server in Figure 3 A and at the Internet service provider and the client system in Figure 
3B and 3C, respectively. 

Turning now to Figure 3A, television programming source 22 broadcasts a 
tdevidon programmmg feed that is displayed to the user on display device 20. A 
television monitoring module 52 at client system 10 has access to the television 
programming feed and detects the identity or the content of the television 
programming used by the user. A more detailed description of one embodiment of a 
television monitoring module is disclosed herdn in reference to Figure 6. 

A user profile 54 compiled at client system 10 is a profile of the user of the 
client system 10 and includes at least information relating to the television 
programming displayed on display device 20. User profile 54 may also include other 
user information fijrther characteriring the user. Examples of such user information 
include draiographic information, Internet usage data, geographical information, or 
other identifying information. U.S. Patent Application Serial No. 09/094,851, filed on 
June 15, 1998, discloses user profiles and spedfic example of user information, many 
of which may be included in the user profiles of the present invention. For purposes 
of disclosure, the foregoing patent apphcation is hereby incorporated by reference. 

The information induded in user profile 54 may be compiled over any desired 
period of time. For example, user profile 54 may be updated each time the user views 
a television program. Information relating to viewed television programming may be 
retained in us^ profile 54 for a set period of time. According to one option, the most 
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recently viewed television progranmung is given more weight in user proffle 54 than 
older progranmung. Alternatively, user profile may include information relating to 
only the most recenUy viewed television programming. 

Client system 10 provides Internet access to the user by means of an Internet 
browser 56, which may be any com^entional or other Internet browser that is adapted 
or otherwise capable of transmitting information included in user profile 54 as fiirther 
described herein. For example, when dient system 10 is a WebTV cUent box. 
Internet browser 56 is the Internet browser typicaUy included in WebTV cUent boxes, 
with the browser being adapted to transmit user profile information. The Intemei 
browser 54 included in cUent system 10 is one example of means for requesting an 
information document fi-om a server computer. 

A user enters commands to dient system usmg input device 58. thereby 
requesting an information document fi-om remote server 16. When cUent system 10 is 
a WebTV cUem box, input device 58 may be a handheld remote control device or a 
wireless keyboard that aUows ti.e user to select and retrieve desired Internet resources. 
Alternatively, tiie input device may be a keyboard, a mouse, or anotiier device tiiat is 
comremionaUy used to provide user input to an Internet browser. It is noted tiiat a 
user may access the Internet by means of die Internet browser 56 at any time after 
having viewed television programming on display device 20. For example, the user 
may interrupt television viewing to access tiie Internet or. alternatively, may access 
the Internet some time after having stopped watching television programming. 

The Internet browser sends a uniform resource locator (URL) via Internet 
service provider 60 to a document retrieval module 62 at remote server 16. For 
example, the network architecture by which client system 10 communicates with 
remote server 16 may be that disdosed in Figure 1. Methods and systems for 
retneving an information document over the Internet or otiier information retrieval 
systems are well known in tiie art. I„ ti,e embodiment of Figure 3A. wherein 
advertisement selection and insertion into the information document is conducted at 
remote server 16, cUent system 10 fijrther sends information from user profile 54 to 
an advertisement selection decision unit 64 at remote server 16. As previously noted, 
the mformation user profile 54 identifies tiie television viewing habits of the user of 
client system 10. 
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In this embodiment, remote server 16 includes features for providing a 
plurality of advertisements and for selecting and inserting an advertisement into the 
requested information document. In one implementation, an advertisement source 66 
suppUes a plurality of advertisements that are stored in advertisement repository 68. 
In one embodiment, advertisement source 66 and remote server 16 may be operated 
by the same party. Alternatively, advertisement source 66 may be operated 
independently from remote server 16 and located at a remote site. The pluraUty of 
advertisements provided by advertisement source 66 may be associated with a wide 
variety of advwtisCTs and goods and s«^ces. 

In this embodiment, remote server 16 further includes advertisement selection 
criteria 70, which, in conjunction witii the user profile information, govern the 
selection of an advertisement stored in advertisement repository 68. For example, the 
selection criteria may provide tiiat an advertisement whose subject matter corresponds 
to the television viewing habits of the user is to be selected, OptionaUy, 
advertisement selection criteria 70 forther incorporates any of tiie conventional 
techniques for selecting advertisements, including selecting an advertisement to 
correspond to tiie subject matter of tiie requested information document. 

Remote server 16 retrieves requested information document 72 from a 
document cache 74 according to methods that will be understood by those skiUed in 
tiie art. The information document 72 may be provided by a content provider who is 
also the operator of remote server 16. Alternatively, tiie content provider who 
provides information document 72 may be an entity tiiat purchases information 
document posting services from the operator of remote server 16. Information 
document 72 may be any Internet resource or anotiier computer^isplayable or 
computer-transmitted data stnicture. For example. Hyper-Text Maricup Language 
documents CmML documents") are commonly retrieved over the Internet and are 
particulariy suited for use with the invention. 

An advertisement insertion module 76 inserts data representing selected 
advertisement 78 into information document 72 after it is retrieved. For example, the 
selected advertisement may be embedded in tiie information document 72 according 
to conventional techniques. After the selected advertisement is inserted, the requested 
information document 72 is transmitted from remote server 16 to client system 10. 
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Internet browser 56 displays the information document 72 and the selected 
advertisement 78 on display device 20, which is one example of means for displaying 
the information document. In this manner, the user of the cUent system views an 
advertisement that is determined to be appropriate based at least in part on the 
television viewing habits of the user. Selecting and inserting the advertisement at the 
remote server is advantageously compatible with current techniques of advertisement 
insCTtion, which are also conducted at the remote server. 

Figure 3B illustrates an embodiment of the invention wherein advertisement 
selection and insertion are conducted at the level of the Internet service provider. 
Television programming is viewed by the user and a user profile 154 is compiled at 
client system 110 in much the same way as described herein in reference to Figure 
3A. When a user requests an information document from a remote server according 
to this embodiment, the URL is transmitted to the remote server via a request router 
80 at the Internet service provider 160. The user profile, however, is transmitted to 
and stored at Internet service provider 160. Information from user profile 154 may be 
transmitted each time the user requests resources fi^m the Internet, at the beginning of 
each Internet session that is served by Internet service provider 160, or periodically at 
any desired interval. For example, client system 110 may update user profile copy 
154' on a daily basis, regardless of whether the user has accessed the Internet during 
the day. Furthermore, Internet service provider 160 may maintain user profile 
information associated with a plurality of client systems. The metiiod of selecting 
advertisements at Internet service provider 160 may be substantially similar to the 
metiiods for selecting advertisements at remote server 16 described in reference to 
Figure 3A. Alternatively, advertisement selection decision unit 164 may select 
appropriate advertisements for client system 110 and compile a Ust of appropriate 
advertisements before any information document is requested by client system 110. 
In tiiis case, the preselected advertisements are already identified and avaUable for 
insertion into requested information documents when the user begins to access to the 
Internet. 

Advertisement insertion module 176 of Figure 3B may insert the selected 
advertisement into tiie requested information document according to one of at least 
two metiiods. First, the information document transmitted from remote server 116 to 
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IntOTiet service provider 160 may include a vacant field or anther location to which 
the selected advertisement may be added. Second, advwtisOTient insertion module 
176 may ovCTwrite an advatis«nent akeady included in the requested information 
document, thereby repladng the existing advertisement with the selected 
advertisement. 

The requested information document, including the selected advertisemmt, is 
next transmitted fi^om Internet service provider 160 to the IntOTiet browser 156 at 
dient system 110. The information document and the selected advertis^ent may be 
displayed at display device 120 according to the methods disclosed m reference to 
Figure 3A. According to the embodiment of Figure 3B, the user receives 
advertisements selected based at least in part on the television viewng habits of the 
user. Selecting and inserting the advertisements at the level of the Internet service 
provider have the advantage of allowing a periodically updated copy of the user 
profile to be stored at the Internet service provider. Accordingly, the Internet service 
provider may preselect advertisonents for the users of a phirality of clirat systrais. 

Figure 3C illustrates a fiuther embodiment of the invention, v^erein 
advolisements are selected and inserted at the dient system. The methods and 
systems for viewing tdevision programmmg, monitoring the television progranmiing, 
and compiling a user profile may be substantially similar to those disdosed in 
reference to Figures 3A and 3B. In this embodiment, however, the advertisement 
selection dedsion unit 264, the advertisement repository 268, and the advertisement 
selection criteria 270 are located at the dient system 210. The user requests an 
information document fi'om remote server 216 via Internet service pro\ider 260 
according to methods that may be similar to those disclosed in reference to Figures 
3A and 3B, with the exception that user profile information does not need to be 
transmitted from client system 210. In particular, a seleaed advertisement 278, which 
may be identified before the user requests any Internet resources from the remote 
server, may be inserted into retrieved information document by Internet browser 256. 

As described in reference to Figure 3B, selected advertisement 278 can be 
mserted into the information document at a vacant field, or instead may replace an 
advertisement already included in information document. The information document 
with the sdected advertisement embedded therein is then displayed to the user on 
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display device 220 ^cording «, U» r^hod. disclosed herein. Accoriing ,„ m 
'-Mmm. fl« advertisemeto are «lec,ed -k) inserted witta, «,„s™i«ing any 
mfon»a,«, rti^ ,„ wevisio. viewing habiu Som dien. sys«m 210. Because the 
I«.m« service provider "» the ,«no«, serve, do not have access ,„ the television 
v.«™g habits Of the user, the pdvacy of the user wiU, r«pect to .Revision habits is 
nuuntained. 

Figure 4 is a flow chart depicting selected steps of the methods associated with 
Rgures3A-3C. ^ step 410, the user views television programnung, and the subject 
matter of the television programming is monitored at the client system. In step 412 
the user profile, including irfbrmation relating to the television viewing habits of thJ 
use, ,s compUed at the cUent system. TT^e user requests an information document 

such as a Web page, using an Internet browser at the client system as iUustrated by 
step 414. In step 416, an advertisement determined to be appropriate based at least in 
pait on the user profile is selected for insertion into the requested information 
document. The selected advertisement is then inserted in step 418 into the 
information document. Steps 416 and 418 may be conducted at the remote server the 
Internet semce provider, or the dient system as disclosed in reference to Figures 3A- 
3C. FmaUy, the requested information document, including a selected advertisement 
IS displayed to the user according to step 420. 

Figure 5 illustrates a further embodiment of the invention, wherein any type of 
information may be selected and displayed to a user based at least in part on the 
television viewing habits of the user. For example, the infonnation displayed to the 
user may be news, educational resources, advertising, entertainment, or any other 
desired type of information. In one implementation, the infonnation .^trieval system 
automatically provides and displays reference information relating to the content of 
the television programming viewed by the user. For example, the reference 
mfonnation may include reviews, infonnation about the cast, and other items of 
interest to television viewers. 

According to the embodiment of Figure 5. a television programming source 
322 provides a television programming feed to display screen 320 according to 
methods described in reference to Figures 3A-3C. Furthermore, television monitoring 
module 352 detects the identity or content of the television progiamming viewed by 
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the user and stores information relating thereto in progranuning information 
rq>ositoiy 382. For example, the programming information may id«itify one or more 
topics associated with the television programming. In this embodiment, client system 
310 farther includes a Bst of information cat^ories 388, eadi b«ng assodated with 
information docum«its stored in a document cadie 374 at remote server 316. A 
cat^ory selection module 384 compares the programming information with the 
information categories to selert at least one information category 386 that coiresponds 
to the television programming viewed by the user. The comparison of the 
programming information with the information categories 388 may be fecilitated by 
sdection criteria amilar to the advertisement selection aiteria disdosed in reference 
to Figures 3A-3C. By way of example, and not by limitation, the selection criteria 
may provide that a selected information category 386 is identified by looking for a 
direct match b^een a keyword in the programming information and a keyword in 
information categories 388. 

When selected category 386 is identified, Internet browser 356 transmits a 
request to remote server 316 via Intern^ service provider 360 for one or more 
information documents assodated with the selected category. Documoit retrieval 
module 326 then retrieves one or more information documents firom document cache 
374. These information documents are thai-dowmlMdedWlntCT^^ 
displayed on display device 320. According to one option, the information document 
may be displayed on display device 320 simultaneously vwth the television 
programming. For example, the information document may be overlaid on a sdected 
region of tiie display device 320 or the display dewce may be divided into a 
split-screen arrangement. According to another option, the information documents 
are displayed on display device 320 only when the television programming feed to 
display device 320 is terminated or when the user affirmatively indicates that it is 
appropriate to display the information documents. 

Information categories 388 may be farther tailored or narrowed to correspond 
to the viewing habits of Uie particular user, periodically updated fi-om a remote source 
such as remote server 316, or selected by the user. For example, if it is noted tiiat a 
user repeatedly views televiaon programming rdated to sports, the information 
categories can be supplemented with subcategories relating to more narrow sports 
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topics. One method offurthertaUoringiirfonnation categories 388 to corr^^^^^ 
frequently viewed topics involves using a user profile similar to those described in 
reference to Figures 3A-3C. For example, a user profile indicating that the user 
frequently views particular sporting events may be used to retrieve subcategories from 
a remote senrer, which then can supplement the standard information categories 388 
Direct user input may also be used to select or fiirther refine infonnation categories 
388. This may be accomplished by providing a large list of infonnation categories 
from which the user may pick and choose to identify the categories that are likely to 
be of most interest. 

According to this embodiment of the invention, retrieval of news 
entertamment, educational resources, or other infonnation documents based at least in 
part on the television viewing habits of the user can be conducted automaticaUy with 
no user assistance. Such techniques provide automatic access to infonnation that is 
likely to be of use and of interest to the recipient. 

Figure 6 illustrates one example of a television monitoring module that may be 
used with the various embodiments of the invention. In this example, television 
prognumning source 22 broadcasts dosed-captioning infonnation 90 in addition to 
standard programming 92. Closed^ptioning infonnation 90 is routed to a dosed- 
captioned monitoring unit 94, which detects keywonis or othenvise detenmnes the 
subject matter of the television programming 92 based on the closed-captioning 
information 90. 

Additionally, television monitoring module 52 accesses an electronic 
programming database ("EPD") 96 that includes written or encoded descriptions of 
the subject matter of television programming 92. Based on the infonnation from 
electromc database 96, EPD monitoring unit 98 detennines the subject matter of 
programming 92. Closed-captioning monitoring unit 94 and EPD monitoring unit 98 
update user profile 54 with the identified subject matter of the programming 92 For 
example, television monitoring module 52 may have access to a plurality of 
programming categories similar to infonnation categories 388 of Figure 5. In this 
case, EPD monitoring unit 98 and closed-captioned monitoring unit 94 identify one or 
more programming categories 100 that best correspond to the subject matter of 
programming 92 and cause these programming categories to be induded in user 
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profile 54. For illustration purposes, Figure 6 shows television monitoring module 52 
as induding a closed captioning monitoring unit 94 and an EPD monitoring unit 98. 
both of which are examples of means for monitoring the television programming 
viewed by the user. However, in many instances, only one of the foregoing 
monitoring units is sufficient to identify the content of the television prognmmung. 
Furthermore, the invention is not limited to monitoring the content of television 
programming using dosed captioning mformation or an dectronic programming 
database, but may utilize other means for monitoring the television programmmg. It 
is also noted that other of the dosed captioning monitoring unit 94 or the EPD 
monitoring unit 98 in combination with programming categories 100 represent but 
one example of means for compiling a user profile. 

The present invention may be embodied in other spedfic forms without 
departing fi-om its spirit or other essential characteristics. The described embodiments 
are to be considered in an respects only as iUustrative and not restrictive. The scope 
of the invention is, therefore, mdicated by the appended daims rathw than by tiie 
foregoing description. AU dianges which come witiun tiie range of equivalency of 
tiie claims are to be embraced witiiin their scope. 
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1. In an infonnation retrieval system inciuding a server computer and a 
client system having a display device, wherein the cUent system has access to 
television programming viewed by a user of the infonnation retrieval system, a 
meAod for inserting an advertisement into a document displayed on the display 
device, the method comprising the steps of: 

compiling a profile of the user of the information retrieval system, 

includmg at least information associated with the television programming 

viewed by the user; 

requesting, by the client system, an information documem from the 
server computer, 

selecting, based at least in part on the profile and on designated 
selection criteria, an advertisement from among a plunOity of advertisements 
for insertion into the information documert; 

inserting data representing the selected advertisement into the 
infonnation documem; and 

displaying the infonnation document, including the selected 
advertisement, on the display device. 

2. A method as defined in claim 1. wherein the step of inserting data 
representing the selected advertisemem is conducted at the server computer. 

3. A method as defined in claim 1. wherem the step of inserting data 
representing the selected advertisemem is conducted by an Internet semce provider. 

4. A method as defined in claim 1, wherein the step of inserting data 
representing tiie selected advertisemem is conducted at the cUem system. 

5. A method as defined in claim 4. fiirther comprising, before the step of 
sdectmg an advertisement, the step of receiving the plurality of advertisements at the 
client system. 

6. A method as defined in claim 5. fiirther comprising the step of storing 
the plurality of advertisements at the cliem system after the step of receiving the 
plurality of advertisements. 

7. A method as defined in claim 1. wherein the infonnation document is 
an HIML document. 
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8. A method as defined in daim 1, wh^dn the step of compiling the 
profile includes the step of including in the profile user mformation fiirther 
charact^izing the user^ in addition to the television programming viewed by the user. 

9. In an information retrieval system including a server computer and a 
client systOTi having a display device, wherdn the client system has access to 
television progranmiing viewed by a user of the information retrieval system, a 
method for inserting an advertisemmt into a docummt displayed on the display 
device, the method compri^ng the steps of: 

compiling a profile of the user of the information retrieval system at 
the client system, the profile induding at least information assodated with the 
television programmmg viewed by the user; 

transmitting the profile fi^om the client syst^ to the server compute, 
requestinjg, by the client terminal, an information document fi^om the 
saver computer, 

selecting, by the server compute-, an advertisemoit fi"om among a 
plurality of advertisements for insation into the information document, the 
advertisement being selected based at least in part on the profile and on 
designated selection criteria; 

inserting, by the server computer, data representing the selected 
advertisement into the information document; 

transmitting the information document, induding the data, to the client 
system; and 

displaying the information document, including the selected 
advertisement, on the display device. 

10. A method as defined in claim 9, wherein the step of compiling the 
profile comprises the step of identifying contmt of the television programming using 
an electronic television programming database having a content description 
corresponding to the television programming. 

11. A method as defined in daim 9, >^iierein the step of compiling the 
profile comprises the step of identifying content of the television programming by 
monitoring closed captioning information assodated with the television 
programming. 



wo 00/54504 



22 



PCT/USOO/05326 



12. A method as defined in claim 9, wherein the step of compiling the 
profile comprises the step of including demographic information associated with the 
user in the profile. 

13. In an information retrieval system including a server compute and a 
client system having a display device, wherein the dient system has access to 
television programming viewed by a user of the infomiation retrieval system, a 
method for displaying information on the display device in response to the television 
programming, the method compriang the steps of: 

monitoring, by the client system, telcNdsion programming viewed by 
the user of the infonnation retrieval system; 

comparing the tdevision programming viewed by the user to a 
plurality of information categories to identify at least one information category 

that corresponds, according to designated selection criteria, with the television 
programming; 

requesting, by the client system, an information document classified 
under the at least one identified information category from the server 
computer; and 

displaying the information document on the display device. 

14. A method as defined in daim 13, wherdn the infonnation document 
includes news. 

15. A method as defined in claim 13, wheran the information document 
includes reference infonnation relating to the content of the television programming. 

16. A method as defined in claim 13, fiirther comprising, prior to the step 
of comparing the television programming viewed by the user to the plurality of 
infonnation categories, the step of selecting the plurality of infomiation categories 
based in part on user input. 

17. A method as defined in claim 13, fiirther comprising, prior to the step 
of comparing the television programming viewed by the user to the pluraUty of 
infonnation categories, the step of selecting the plurality of infonnation categories 
based at least in part on a profile of the user. 

18. A method as defined in claim 17, wherein tiie profile includes 
infonnation associated with Uie television programming viewed by tiie user. 
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19. A method as defined in claim 13, wha-dn the step of requesting an 
information document is conducted without direct user assistance. 

20. A computer program product for implementing a method of displaying 
an information document including an advertisement selected at least in part on 
television programming viewed by a user of an information retrieval system, vdierein 
the method is implemented in a client system of the infonnation retrieval system, the 
computer program product comprising: 

a computer-readable medium carrying computer-executable 
instnictions for implementing the method, \s*erein the computer-executable 
instructions comprise: 

program code means for monitoring television programming 
viewed by the user, 

program code means for compiling a user profile, wherein the 
user profile includes information assodated with the television 
programming viewed by the user, 

program code means for requesting an infonnation d oc u ment 
fi'om a server computer, and 

program code means for displaying the information document 
having the advertisemaxt included therein, wherein the advertisement 
has been selected fi-om a plurality of advertisements based at least in 
part on the user profile. 

21. A computer program product as defined in claim 20, wherein the 
computer-executable instructions further comprise program code means for initiat'mg 
transmission of the user profile to the server computer, wherein the advertisement is 
selected fi-om the plurality of advertisem^ts at the s^er computer. 

22. A computer program product as defined in claim 20, vs^erein the 
computer-executable instructions fiirtiier comprise program code means for initiating 
transmission of the user profile to an Internet service provider, wherein the 
advertisement is selected fi'om the plurality of advertisements at the Internet service 
provider. 
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23. A computer program product as defined in claim 20, wherein the 
computer-executable instructions further comprise program code means for selecting 
the advertisement from among the plurality of advertisements at the cUent terminal. 

24. A computer program product as defined in daim 23, wherein the 
computer-executable instirictions further comprise prognmj code means for receiving 
the pluraUty of advertisements from an advertisement source and storing the pluraUty 
of advertisements at the client system. 

25. A computer program product as defined in claim 23, wherein tfie 
computernsxecutable instmaions further comprise program code means for inserting 
data representing tiie selected advertisement into the information document. 

26. A computer program product as defined in claim 20, wherein the 
progiBm code means for monitoring television programming comprises program code 
means for monitoring an electronic programming database that inchides content 
descriptions assodated witii tiie tdevision programming. 

27. A computer program product as defined in daim 20, wherein tiie 
program code means for monitoring television programming comprises program code 
means for monitoring dosed captioning information associated with the television 
programming. 

28. A system configured to display an information document including an 
advertisement selected at least in part on television programming viewed by a user of 
the system, the Systran comprising: 

a home entertainment system for providing tiie tdevision programming 
viewed by the user, including: 

a television programming feed for ddivering the tdevision 
programming; and 

a tdevision for displaying tiie tdevision programming; and 
an information retrieval system including: 

means for monitoring tiie television programming viewed by 
the user; 

means for compiling a user profile, induding at least 
information assodated witii tdevision programming viewed by the 



user 
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means for requesting an information document from a server 
computer, and 

means for di^Iaying the information document having the 
advertisement included therein, wherein the advertisement has been 
selected from a plurality of advertisOTients based at least in part on the 
user profile. 

29. A system as defined in claim 28, wh^m the means for displaying the 
information document comprises the television of the home entertainment system. 

30. A system as defined in claim 28, wherein the means for requesting an 
information document comprises an Internet browser. 

31. A system as defined in claim 28, v^erein the means for monitoring the 
television programming viewed by the user con^)rises an electronic programmmg 
database monitoring unit. 

32. A system as defined in claim 28, wherdn the means for monitoring the 
tdeviaon programming viewed by the user comprises a closed captioning monitoring 
unit. 
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